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CHAPTER  1 


PROBLEM  FORMULATIONS 

1.1  Introduction  and  Review  of  Literature 

States  of  nature  or  observed  data  are  often  stochastically  modelled 
as  Gaussian  random  variables.  At  times  it  is  desirable  to  transmit  this 
information  from  a  source  to  a  destination  with  minimal  distortion. 
Complicating  this  objective  is  the  possible  presence  of  an  adversary 
attempting  to  disrupt  this  communication. 

In  this  thesis,  solutions  are  provided  to  a  class  of  minimax  and 
tnaxirain  decision  problems,  which  involve  the  transmission  of  a  Gaussian 
random  variable  over  a  communications  channel  corrupted  by  both  additive 
Gaussian  noise  and  probabilistic  jamming  noise.  The  jamming  noise  is 
termed  probabilistic  in  the  sense  that  with  nonzero  probability  1-P,  the 
jamming  noise  Is  prevented  from  corrupting  the  channel.  We  shall  seek 
to  obtain  optimal  linear  encoder-decoder  policies  which  minimize  given 
quadratic  distortion  measures. 

Both  deterministic  (pure)  and  mixed  encoder  strategies  are 
investigated.  If  the  encoder  mapping  is  allowed  to  be  a  mixed  policy, 
it  is  assumed  the  decoder  has  access  to  the  particular  encoding  policy 
adopted.  This  could  be  via  a  side  channel  which  informs  the  decoder  of 
the  outcome  of  the  chance  mechanism  that  determines  the  encoder  policy 
adopted.  Or,  as  noted  in  [i],  this  can  be  considered  third  party 
information  fed  separately  to  both  the  encoder  and  the  decoder,  which  is 
a  structure  often  prevalent  in  antijamming  systems. 

If  the  jammer  has  access  to  the  encoded  message  (or  in  one  case  a 


noisy  version  of  it),  solutions  under  four  different  distortion  measures 
are  considered.  When  the  jammer  has  access  to  the  source  message 
itself,  the  problem  is  formulated  with  hard  constraints  on  the  channel 
input  power  and  jammer  power.  In  this  thesis,  we  allow  only 

0  <  P  <  1.  For  the  case  of  P  =*  0,  i.e.,  with  probability  1,  the  jammer 
is  prevented  from  corrupting  the  channel,  the  model  reduces  to  the 
simple  Gaussian  test  channel  treated  in  [4]  and  [5],  where  complete 
solutions  are  given.  The  case  of  P  *  1,  i.e.,  with  probability  1,  the 
jammer  is  present  on  the  channel,  has  also  been  previously  examined. 
Optimal  solutions  among  all  encoder-decoder  policies  for  the  P  *  1  case 
are  given  for  problems  in  [1],  [3],  and  [4].  Optimal  linear  solutions 
are  found  for  an  extended  model  with  a  vector  channel  in  [2],  Reference 
[6]  obtains  performance  bounds  of  block  codes  used  for  the  transmission 
of  a  sequence  of  random  variables.  The  transmission  of  a  scalar 
discrete-time  Markov  process  over  a  channel  is  studied  in  [7],  and  in 
[8],  the  problem  of  transmission  of  a  stochastic  process  over  a 
continuous-time  channel  is  treated. 

For  the  communication  problems  with  a  probabilistic  jammer 
formulated  in  this  thesis,  we  restrict  ourselves  to  obtaining  linear 
solutions  mainly  because  of  problem  tractability ,  and  also  to  ensuring 
that  the  resulting  structures  are  readily  impleraentable . 

1.2  Complete  Description  of  Problems 

The  primary  references  for  these  problems  are  [1],  [3]  and  [4],  We 
consider  two  basic  communication  structures,  depending  on  whether  the 
jammer  has  access  to  the  source  message  or  the  encoded  message. 


Problem  1  Jamming  Noise  Correlated  with  Encoded  Message 


Consider  the  communication  system  depicted  in  Fig.  1.  After 
appropriate  scaling,  if  necessary,  the  source  message  is  considered  to 
be  a  zero  mean  unit  variance  Gaussian  random  variable.  Let  [""*  be  the 
space  of  all  deterministic  linear  mappings  from  R to  IR.  for  the  encoder, 
be  the  space  of  all  deterministic  linear  mappings  from  R  to  IR  for 
the  decoder,  and  Fj  be  the  space  of  random  mappings  for  the  jammer.  The 
output  of  the  channel  (input  of  the  decoder)  is  z  where 


v  -  (°  W*P 

1  V  w.p 


V  -  8(y) 


(1.2b) 


Here  8  e  |  j  is  in  general  a  random  mapping,  and  the  channel  noises  w^ 
and  W2  are  zero  mean  independent  Gaussian  random  variables  with 
covariances  ^  and  respectively.  Further,  w^  and  W2  are  independent 
of  x,  v,  and  v.  From  (1.2a)  we  see  the  jammer  is  probabilistic,  in  that 
with  probability  (w.p.)  1-P  the  jammer's  output  does  not  corrupt  the 

channel.  The  jamming  noise  is  otherwise  arbitrary  in  terms  of  its 
statistical  description. 


Within  this  framework,  four  different  problems  are  considered. 
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Fig.  1.  Structure  for  Problem  1.1  with  Criterion  Cl 
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Problem  1.1  Hard  Constraints  on  Encoder  and  Jammer  Power 

It  is  assumed  that  there  exists  a  channel  input  power  constraint 


E{[y(u)]2}  <  c2  (1.3) 

and  a  jammer  power  constraint 

E{[6(y)]2}  <  k2  (1.4) 

where  E{ • }  denotes  the  unconditional  expectation  operation.  Performance 
is  measured  by  the  quadratic  fidelity  criterion 

Cl:  R(y ,5,8)  -  E{[u-6(z)]2}  (1.5) 

*  *  *  P  p> 

We  seek  a  triple  (k  ,  S  ,  8  )  e  I  x  D  x  I  j 

satisfying 

R(y  ,  5*,  8)  <  R(y*,<5*,8*)  <  R( y»  5 , 8* )  (1.6) 

for  all  (y,5,8)  e  PxDt  xH 

A  triple  satisfying  (1.6)  constitutes  a  saddle-point  solution,  and  (1.6) 
is  termed  the  saddle-point  Inequality.  For  Problem  1.1,  such  a  triple 
is  obtained  and  verified. 

The  risk  functional  given  by  criterion  Cl  is  the  mean  square  error, 


where  Che  error  is  the  difference  between  the  source  message  and  decoded 


message.  The  objective  of  the  encoder-decoder  pair  is  to  minimize  this 


functional,  under  the  hard  constraint  of  (1.3),  while  the  jamming  policy 


attempts  to  maximize  this  functional,  under  the  hard  constraint  of 


(1.4).  As  noted  in  [3],  it  may  sometimes  be  desirable  to  incorporate 


the  power  levels  of  the  encoder  and  decoder  into  the  actual  risk. 


functional.  When  this  is  done,  the  power  constraints  are  termed  soft. 


For  the  following  three  problems,  further  assumptions  are  made  to 


structure  given  in  Fig.  1.  Specifically,  o  *  0,  <^=*  0,  and  w^  *  w 


so  that  the  decision  variable  z  becomes 


z  =>  x  +  v  +  w 


(1.7) 


f  ° 

[  8 (x) 


(1.8) 


Here,  the  jammer  now  has  access  to  the  exact  value  of  the  encoded 


message.  This  leads  to  the  structure  depicted  in  Fig.  2,  which  is 


analyzed  under  three  different  soft  constraint  fidelity  criteria  given 


below: 


Problem  1.2  Soft  Constraints  on  Encoder  and  Jammer 


2  2  2 
C2:  R(y,5,8)  “  E{c  Y  (u)  +  [u-S(z)]  -  k  v  } 

o  o 


(1.9) 
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Problem  1.3  Soft  Constraint  on  Jammer 

C3:  R(y,6,B)  =■  E{  [u-6(z)]2  -  k  v2}  (1.10) 

o 

and  E{y2(u)}  <  c2 

Problem  1.4  Soft  Constraint  on  Encoder 

C4:  R(y ,6,8)  =  E{c  y2(u)  +  [u-6(z)]2}  (1.11) 

o 

and  E{v2}  <  k2 


For  these  problems,  cQ  and  kQ  are  positive  scalars. 

We  find  that  Problems  1.2  and  1.3  admit  saddle-point  solutions, 
just  as  Problem  1.1  does.  However,  Problem  1.4  does  not;  hence^we  seek 

l 


encoder-decoder  policies  (y  ,  6  )  e  x  D9  satisfying 


sup  R(y  ,5,6) 


inf  sup  R(y,5,B) 


Be  I  j 


YcT 

6eD„ 


(1.12) 


Bel  j 


Such  policies  constitute  alniaax  decision  policies  for  the  encoder- 
decoder  pair.  Further,  we  denote  the  policy  Be  fj  which  maximizes 

^  — Jt  —  ic  —if  —A 

R(y  ,6  ,8),  if  it  exists,  by  B  ,  and  call  the  triple  (y  ,  5  ,  8  )  a 
ainiaax  solution.  For  Problem  1.4,  a  minimax  solution  is  obtained. 

*  P 

We  can  also  seek  a  jammer  policy  B_  e  |  j  satisfying 


inf  R(y,5,8_  )  =  sup  inf  R(y,<5,B) 

Ye  P  8e  lj  ys  P 


(1.13) 


Such  a  policy  is  called  a  aaxiain  policy  for  the  jammer. 

Correspondingly,  we  denote  a  pair  (y,S)  e  Tx  which  minimizes 

*  *  *  *  *  * 

R(y,5,£  )  by  (X  )»  anc*  call  the  triple  (X  ,£  )  a  aaximin 

solution. 

Finally,  we  note  that  if  a  pure  strategy  saddle-point  solution 

exists  in  r*v  r;  ,  then  the  encoder-decoder  pair  (y  ,<$  )  satisfying 

— *  — * 

(1.6)  will  be  the  same  pair  as  (y  ,6  )  in  (1.12),  i.e.  (  it  also 

•k 

constitutes  a  rainimax  policy.  Also,  letting  u  denote  the  probability 

*  * 

distribution  which  generates  the  random  mapping  8  in  (1.6),  then  y  is 
said  to  be  the  lease  favorable  distribution  for  the  random 
variable  v.  For  a  more  complete  treatment  of  minimax  and  saddle-point 
policies,  see  [9]. 

For  the  following  two  problems  it  is  assumed  that  the  jammer  has 
uncorrupted  access  to  the  source  message. 


Problem  2  Jamming  Noise  Correlated  with  Source  Message, 

Mixed  Encoder 

The  communication  system  considered  is  depicted  in  Fig.  3.  We  now 
allow  the  encoder  to  adopt  mixed  policies  and  introduce  a  forward  side 
channel  from  the  encoder  to  the  decoder.  This  side  channel  carries 
probabilistic  information  to  the  decoder,  when  the  encoder  policy  is 
random.  To  incorporate  the  possibility  of  a  random  encoder  mapping  into 
the  problem  formulation,  we  introduce  an  additional  notation  and  let  P e 
be  the  space  of  all  random  linear  encoder  policies.  Then  the  problem  is 
formulated  as  in  Pl.l,  with  P  replaced  by  PQ.  Hence,  we  have  hard 
constraints  on  both  the  encoder  power  and  jammer  power,  and  adopt  the 
mean  square  error  fidelity  criterion  Cl.  For  this  problem,  a  saddle- 
point  solution  is  verified. 


Jammer 


Problem  3  Jamming  Noise  Correlated  with  Source  Message, 
Deterministic  Encoder 


This  problem  is  the  same  as  formulated  in  Problem  2,  but  here  the 


encoder  is  restricted  to  be  deterministic.  For  this  problem,  minimax 


and  maximin  solutions  are  obtained. 
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CHAPTER  2 


PROBLEM  SOLUTIONS  FOR  THE  COMMUNICATION  SYSTEM 


In  this  chapter,  solutions  are  presented  for  the  communication 
problems  introduced  in  Chapter  1.  First,  in  Section  2.1,  the  solutions 
to  problem  1  are  presented.  In  Section  2.1.1,  saddle-point  solutions 
for  problem  1.1  are  derived.  Next,  in  Section  2.1.2,  the  case  of  soft 
constraints  on  both  the  encoder  and  the  decoder  (problem  1.2)  is 
examined.  This  problem  is  partially  solved,  in  that  for  some  regions  of 
the  parameter  space,  a  saddle-point  solution  is  shown  to  exist.  A 
partial  saddle-point  solution  is  also  obtained  for  problem  1.3,  and  a 
minimax  solution  is  derived  for  problem  1.4. 

In  Section  2.2,  solutions  to  problems  2  and  3  are  presented.  For 
these  problems,  the  jammer  has  access  to  the  source  message.  A  saddle- 
point  solution  is  given  in  Section  2.2.1  for  the  case  in  which  the 
encoder  is  allowed  to  be  mixed.  This  is  followed  by  minimax  and  raaximin 
solutions  for  problem  3  where  the  encoder  is  restricted  to  be 
deterministic. 

Finally,  Section  2.3  summarizes  and  discusses  the  solutions  of  the 
6  problems  which  were  examined. 


2. I  Problem  1 


2.1.1  Saddle-Point  Solution  under  Hard  Constraints  (Pl.l) 

The  communication  system  under  consideration  is  depicted  in 
Fig.  1.  We  define  the  following  regions  of  the  parameter  space. 
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MW 


WWW 


R.  :  k  >  -s-tc  +  ♦,  +  <J] 
P 


2  12 

k  <  -y[c  <#> ,  +  cr] 
P 


2  Pk(c  +$,) 

Pk  -  — - Y/Z  +  *2  >  0 

[c  -h^+o] U 

2  Pk(c2-Hj>.) 

^  -  — - TJ2  ~  *2  <  0 

[c  +<j>  L+a] 1/2 


(2.1) 


Theorem  2.1  The  communications  problem  Pl.l  admits  2  saddle-point 

*  *  *  *  *  *  PI  pi 

solutions  (y  ,5  ,8  )  and  (-y  ,-6  ,6  )  over  J  x  x  I  j  where 


r*(u)  -  ^ 


arbitrary 


(2.2) 


8*(y) 


— ky  /  ( c  2  -h^  ^  +xr  ) 1  ^  2 


(Pk  -HJ>2  )y 
P(c2+t1) 


in  R2 

r2(  V3 


(2.3) 


is  a  zero-mean  random  variable,  independent  of  x,v,v,w^,w2, 


with  second  moment 


2  2  (Pk2+<f>2)2  (c^^+o) 

E{n  }  -  k  -  [ - 5 — 5 - 5 - 

p  (c +*1r 


-j>.v.v.v  V.V  V 


c(  1+PX) 


(c  -h^KH^PX+PX  )  +  PX  a+$2 


c  A  .  * 

— 9 -  z  “  2 

(c  +  ♦,)  % 


and  the  saddle-point  value  of  R  is 


*  *  * 
R(y  ,«  ,6  ) 


r20 


(A*  c-1)  +(A^)2(4>1+*2+Pk2)  +  R2PlR3 


2PkA[c2+!()1+o]1/2 


c 

2  2 
(C++.) 


2  r\ 

(Pk  ++J++2+  —)  R2(  )  R4 


(2.5) 


where 


Ar  (Ar*  o  +  c) 

.  A  ,  *.2  .  3  *3 

l  =*  [-(A  )  +  - - - 

3  (c  +$^+(7) 


The  solution  is  the  same  even  if  the  encoder  is  allowed  to  use  mixed 
policies  on  1  ,  provided  that  a  private  side  channel  is  available  from 

the  encoder  to  the  decoder. 


Proof .  We  show  that  the  solutions  given  by  Theorem  2.1  satisfy  both  the 
left-hand  side  (LHS)  and  right-hand  side  (RHS)  inequalities  of  (1.6). 
Consistent  with  the  problem  formulation,  let  y(u)  “  eu,  <5(z)  *  A z  for 
some  value  of  e  and  A.  Thus,  using  the  fidelity  criterion  Cl, 


«tvw 


VXCWiKS'i 


R(Y,5,3)  -  E{(u-«(z))  } 


E{ (u~A(v+eu+v  ^-k»2)  ^  ^ 


Evaluating,  we  obtain 


(2.6) 


R  -  (Ae-1)2  +  A2(4>1+4»2)  +  A2p2  +  2A(Ae-l)t  +  2A2q 


(2.7) 


where 


p2  ^  PE(e(y)2} 
q  »  PE{w18(y)} 
t  *  PE{u6 (y )} . 


(2.8) 


We  first  optimize  over  the  decoding  coefficient  A.  Taking  the 
derivative  of  R  with  respect  to  A, 


3R  2 

—  *  2(Ae-l)e  +  2A(<^+$2+p  )  +  2(2Ae-l)t  +  4Aq 


and  setting  3R/3A  *  0  yield 


_ _ e  +  t _ 

2  2 

(e  +  p  +<^^+^2+2et+2q) 


(2.9) 


as  the  unique  minimizing  A  for  any  encoder  xaeu,  provided  the  second 
2  2 

derivative  3  R/3A  is  greater  than  zero. 


v.vv: 


y>  kT*  W>  ii*  WX  WX  *>  WX  V>.  i.^  ->  ->  \.  -  ->  U>  k>  W>  »>  -  •  V  •  W> 


!R 


Substituting  (2.9)  into  (2.7),  we  obtain 


(  P2  +  ( 4>  L  +■<<>  2  ^  +  29_t2 

*  ”  2  2 

'A  (e  +p  +$ . +$,,+2et+2q  ) 


Further, 


y  »  2[e2  +  ($,+$-+p2)  +  2et  +  2q ] 
3A 


(2.10) 


(2.11) 


With  this  preliminary  work  established,  we  now  verify  the  2  inequalities 
for  each  of  the  parameter  regions 
a)  RHS 

Rl .  From  (2.3),  fix  8(y)  *  -y/P.  Since 
E{8(y)2}  "  — j(e2+$1+o)  <  ~^<c2+  i^+a)  <  k2in  R1 , 


8(y)  as  chosen  is  an  admissible  policy.  From  (2.8),  t  *  -e; 

*  2  2 
thus  A  =0  from  (2.9),  verifying  (2.4)  in  Rl,  provided  3  R/3A  >  0. 

We  have 


2  12 
p  =■  ^(e  -H^+o) 


q  “  “♦i 


so  that 


3  R  ,r  2, 1  ,1 

— j  -  2 [e  (y  -  1)  +  $L(p 

3A 


1)  +  $2  +  'p0!  >  0 


8 


as  needed,  since  0  <  P  <  1. 


v,  , 


i 

i 

>’  • 

<*  : 


’>  WVV.vV.V.V  rvW  >V.V.V»V  V 


;%>  K'  ;w  w,  ^ 


1  achieved 


It  follows  that  R  admits  a  global  minimum  R  * 


by  A  *0,  y(u)  *  eu,  e  being  arbitrary  but  e  <  c,  thus  verifying  (2.2) 


and  (2.4)  in  Rp  In  this  case,  the  jammer  has  sufficient  power  to  do 


the  best  that  could  possibly  be  achieved. 


R2^*S  Prom  (2.3),  fix  8(y)  -  Xy.  Since 


E{S(y)  } 


(c  +^+£0 


(e2+$^+cj)  <  k2  in  R2  0^3> 


8(y)  as  chosen  is  an  admissible  policy. 


From  (2.8),  p2  *  PX2(e2+$i+c) ,  q  *  PX^ ,  and  t  =  PXe. 


Thus,  (2.11)  becomes 


Mr  -  2 [e2(  1+2PX+PX2)  +  (1+2PX+PX2)  +  +  PX2a]  >  0 

3A 


as  needed.  From  (2.9) 


e(l+?X) 


[e2(l+2PX+PX2)  +  <)>1(1+2PX+PX2)  +  4>2  +  PX2p] 


(2.12) 


and  from  (2.10) 


e2(PX2-P2X2)  +  j>1(l+2PX+PX2)  +  4>2+  PX2o 


A*  e2(  1+2PX+PX2)  +  ^(l+ZPX+PX2)  +  +  px2j 


We  now  optimize  R  ^  over  the  coefficient  e.  Since 


( l+2PX+PX<i)  >  0,  (PX2-P2X2)  >  0,  and  (1+2PX+PX*)  -  (PX^-P"V)  >  C,  rJ 


2  „2, 2. 


7 

is  strictly  decreasing  in  e;  thus,  R  *  is  minimized  by  choosing  e~  as 

A 


I 


Eg 


£ 

& 

I 


y 

$ 

ijf 

$ 


I 


1 


$ 


£ 


I 

I 


Bj 


large  as  possible,  i.e., 


±  c.  This  verifies  (2.2)  and  (2.4)  in 


&2  0^3* 


l2  HR4  From  (2.3),  fix  B(y)  ■  -a  y+n. 


2  2 

where  a  *  (Pk  +$2)/P(c  +4^).  Since 


2  2 

o  «  ( Pk  ^4  o)  7  7  7  a 

E{fl(y)  }  -  k  -  (c  re  )  <  k  in  R2  ||  R4, 


2,  2^  %2 
p  (c  +4^) 


8(y)  as  chosen  is  an  admissible  policy.  From  (2.8) 


2  2  2  2  2 

p  ■  P(k  -a  (c  -e  )),  q  *  -Pa  ,  and  t  =*  -Pa  e. 

P  pi  P 


Thus,  (2.11)  becomes 


*  2[e2(l-2Pa  +Pa  2)  +  ♦,(l-2Pa  )  +  Pk2-a2PC2+  <U 

3A2  p  p  1  p  P  ^ 


Using  (l-2Pa  +Pa  )  >  0,  then 
P  P 


2 

>  2 [4»  ,(l-2Pa  )  +  (4>,Pa  2-4»,Pa  2)  +  Pk2-a  2Pc2+4>,]. 
3A2  1  P  -  1  P  1  P  P  2J 


Noting  that  Pk2  +  $2~Pa  ^(c2+$j)  =.  (Pk2+$2)(  1-a  ) 


32R 

it  follows  that  — ~  >  0  provided  a  <  1. 

si2  p 
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Using  the  definitions  of  a^  and  R4,  we  have  a^  <  k/(c  +4>^+o)  .  As  a 

2  1/2 

function  of  k/(c  -H^+a)  the  boundary  equation  for  R4  is  quadratic  and 


has  roots 


<2  2  2 
P  (c  +^) 


P(c  +1^)  j  P  (c  +<^) 

r . ,  r  ^  m  *  i  /  y  o 

(c  +^+0)  7  (c  +4^+0) 

2P 


-  4P^»2/(c  +^+0) 


Since  the  quantity  under  the  radical  is  positive  in  R2  0R4>  and  since 

(c^-Hfrj  )/(c2+t^+o)  <  1,  then  this  implies  k/(c2+$  ^+cr)  <  1  in  R2  P)  R4. 

2  2 

Thus  it  follows  that  a  <  1  and  3  R/3A  >  0.  Continuing,  it  can  be 

12  * 

*  is  again  decreasing  in  e  ;  thus,  e  »  ±  c,  and  that  with 

4  *  2 

e  *  c  in  (2.9)  we  obtain  4  *  c/(c  verifying  (2.2)  and  (2.4)  in 

r2  n  r4- 


b)  LHS 


R^.  Fix  (y,d)  as  in  (2.2)  and  (2.4).  With  <5(z)  *  0,  R  *  1 
and  hence  is  independent  of  S  ef"j,  making  any  B  e  Pj  a  maximizing 
solution,  thus  verifying  (2.3)  in  R^. 


R2  P)  R^j.  Fix  (y,6)  as  (cu,  AR  z).  Using  (2.7),  then  R  is  given  by 


R  -  (Ar  c-l)2  +  A  r2(^  +  $2)  + 

P  ^2AR  (  Ar  c-1)  E{uS(y)}  +  Ar2  E(B^y  )}  +  2ar2E{wj  S(y )  }j 


The  problem  becomes 


u'l 


i 


sun  2ar  (Ar  c-1)  E{u8(y)}  + 
Bel]  3  3  *2 

—  +  2A_  E(w. 


A  E{0(y)  } 
R3 


subject  to 


2a^  E{w^S(y)} 


E{6(y)2}  <  k2 
y  a  cu  +  w^  +  s 


(2.13) 


We  use  a  result  from  [4],  (Equation  17,  p.  155),  which  shows  us  that 
this  supremum  is  achieved  by  the  policy 


8*(y) 


where 


[Ey{ir(y)2}]1/2 


A*  (A^  a+c) 

*  K- 

-ar  +  - - - - 

3  (cZ  +  ^  +  0) 


provided  l  >  0. 


It  can  be  shown,  after  some  algebra,  that 

: k 

AR,  2  Pk(c2+<! >,) 

l  ”  2  2  TTl  +  ^2^ 

(l+PX)(c  +$^+0)  (c  +$^+0) 

which  is  positive  in  R2  O  R3.  Thus,  the  policy  8  (y)  reduces 
to  8  (y)  *  -ky/(c2+j>^+0)  ^2  =  Xy  ,  verifying  (2.3)  in  R2  0  E3. 


R2  ^  R4  '  (t,<5)  as  (cu,  AR  z).  It  can  be  shown  that 


m 


2  2  Pc2  2  ^lu 

R - ^ - 2  (^1^2^l/c  }  +  "2 ~  2  E{v “2v(-“  -  w^}  (2.14) 


(c  -N^) 


(c  44P 


where  v  ■  8(y)f  y  =  cu  +  w^  +  s.  Using  Che  fact  that 


*lu  i 

e  {— —  wJy}  * 

y 


[4]  shows  that  the  maximizing  solution  is  any  probability  measure  u  with 


the  property 


/  v2du(v)  ■  k2. 


B  (y)  as  given  by  (2.3)  in  R2  0  R4  satisfies  this  condition. 


Saddle-point  Value  of  R 


Rj.  Clearly,  with  A  =  0,  R  *  1. 


R2  0^3*  Using  (2.7)  and  the  definition  of  l,  R  becomes 


R*(y*,«*,6*)  -  (A*  c-1)  +  (A*  )2(c^1+<^2+Pk2)  +2PKZ(c2+<fr1+CT)1/2 


R2 R^*  Using  (2.14),  we  obtain 


R  (y  ,<5  ,0  )  «  — j -  (Pk^  +  4^  +  <f>2  +  tf/c*). 


(c  +4^) 


gg 
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Equation  (2.5)  is  verified  in  each  case. 

The  proof  of  Theorem  2.1  is  thus  complete.  In  passing,  we  note 
that  when  P=1  the  solution  obtained  here  is  identical  to  the  solution 
obtained  in  [4],  With  P*l,  the  solution  is  optimal  among  all  encoder- 
decoder  policies  under  the  additional  specification  that  the  random 
variable  n  also  is  Gaussian.  This  is  true  because,  as  noted  in  [4],  all 
random  variables  are  Gaussian,  and  the  optimal  estimator  E{u|z},  the 
conditional  mean,  is  linear  in  the  observation  z.  With  P^O,  the  problem 
becomes  the  Gaussian  test  channel  treated  in  [5]. 

We  now  discuss  the  problem  of  the  encoder-decoder  adopting  a  mixed 
strategy  of  the  form  (y.S)  “  (ecu,  CAz),  where 


1  w.p.  r 

-1  w.p.  1-r 


(2.15) 


0  <  r  <  1 


As  noted  previously,  in  this  case  we  assume  the  decoder  has  access 
through  a  side  channel,  as  in  Fig.  3,  (but  with  the  jammer  tapping  the 
channel  after  encoding),  to  the  chance  mechanism  whlcn  determines  the 
particular  coding  strategy  adopted.  If  this  is  so,  using  (2.13)  and 
(2.15),  the  problem  faced  by  the  jammer  becomes 


sup  [2A(Ac-l)  E(euS(y)}  +  2&^  E{w.3(y)}  +  A^E{8(y)^}] 

Be  fj 

where  y  =  ecu  +  w^  +  s.  However,  conditioning  on  y  we  find  that 


E(eu|y}  =*  cy/(c  +$^+o)  independent  of  r 


and 


-  .AX-Wt.J.*#, 


2 

E(WJ  y}  =  $^y/(c  +$^+o)  also  Independent  of  r. 

Consequently,  the  jammer  faces  the  same  problem  as  if  the  encoder- 
decoder  policies  were  pure.  A  mixed  policy  of  this  type  can  not  further 
help  to  defeat  the  jammer. 

A  A  A  AAA 

In  summary,  we  have  shown  that  both  (y  ,5  ,0  )  and  (-y  ,-5  ,3  )  are 
saddle-point  solutions  for  Pi.l. 


2.1.2  Partial  Saddle-Point  Solution  under  Soft  Constraints  (PI. 2) 

The  communication  system  under  consideration  is  depicted  in 
Fig.  2.  We  define  the  following  regions  of  the  parameter  space. 


R.:  c  >  k  /P 
loo 

R7:  c  <  k  /p" 

4  0  0 


(2.16) 


A  saddle-point  solution  is  presented  for  region  R^.  For  region  R2, 
-sufficient  conditions  are  obtained  for  a  linear  jamming  policy  to  be  in 
saddle-point  equilibrium.  Using  computer  verification,  it  is  found  that 
these  conditions  are  met  for  a  broad  subregion  of  R2* 


Theorem  2.2  The  communication  problem  PI.  2  admits  a  saddle-point 

*  *  *  p  p 

solution  (y  ,5  ,3  )  in  region  R^  over  I  x  x  I  j  where 


Y  (u)  -  0 


3  (x)  =*  -x/P 


(2.17a) 


<5  (z)  *  0, 

and  the  saddle-point  value  of  R  is 


*  *  * 

R(Y  ,6  ,8  )  -  1 


Proof .  We  use  a  reasoning  similar  to  that  used  in  the  proof  of  Theorem 
2.1.  Letting  y(u)  *  eu,  <5(z)  *  Az,  along  with  fidelity  criterion  C2,  we 
obtain 


R(Y,5,6)  *  [(Ae-1)2  +  A%  +  A2p2  +  2A(Ae-l)t] 

+  [c  e2  -  k  /Pp2] 
o  o 


(2.18) 


where 


p2  -  PE{8(x)2} 
t  -  PE{u6 (x)} 


Optimizing  (2.18)  first  over  A  yields 


e+t _ 

2  2 

(c  +p  +<()+2et) 


(2.19) 


(2.20) 


2  2 

as  the  unique  minimizing  A  for  any  x  *  eu,  provided  3  R/9A  >  0  . 
Substituting  (2.19)  into  (2.18)  yields 


|  ,  -  +  [coe2-/p2] 

A  (e  +p+$+2et) 


(2.21) 


Further, 
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*4  *  2te2  +  ($+p2)  +  2ec]  • 


(2.22) 


We  now  verify  the  2  inequalities  of  (1.6). 


2  2 

a)  RHS  Fix  8(x)  *  -x/P.  Then,  from  (2.1^),  t  *  -e,  and  p  *  e  / P. 
From  (2.20),  A*  *  0,  and  from  (2.22)  32R/3A2  >  0. 


Using  (2.21) 


rI  *  -  1  +  (c  -k  /P2)  e2 
•  *  o  o 

A 


Since  c  -k  /P2  is  positive  in  R, ,  R|  .  is  clearly  minimized  by  e*  *  0. 
O  O  11* 


b)  LHS  With  (e  ,A  )  “  (0,0),  the  problem  faced  by  the  jammer  is 


sup  E{l-k  P8(x)  }. 
6  ° 


Thus,  any  choice  8  such  chat  E{6(x)  }  *  0  attains  Che  supremum,  and, 

with  x*e*u  ■  0  almost  surely,  8(x)  *  -x/P  is  one  such  policy. 

*  *  * 

This  verifies  (2.17a).  Clearly,  R(y  ,<5  ,8  )  ■  1,  verifying 

(2.17b).  This  completes  the  proof  of  Theorem  2.2. 

Region  R2  is  now  considered.  We  fix  the  jammer's  policy  to  be 

linear  in  its  observation,  i.e.,S(x)  »  lx.  Using  the  notation  developed 

2  2  2 

in  the  proof  of  Theorem  2.2,  p  =»  PX  e  and  t  *  PXe,  so  chat 


~  -  2 (e2(  1  +  2PX  +  PX2)  +  d> ]  >  0  in  R,. 
3A 


P 

ft 

If 

mu 


W/i 
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MW® 


mf 

SI 


If 


Therefore, 


e( 1+PX) _ 

(e2( 1+2PX+PX2)  +  4>  ] 


and 


2  2  2  2 
e  (PX  -P  A  ;  +  »  + 

e2( 1+2PX+PX2)  +  $ 


2  2 

(c  -k  X  )e 
o  o 


We  now  minimize  (2.23)  over  Che  coefficient  e. 


(2.23; 


(2.24) 


Let 


A  2 
a  =  e 


and 


<*j  -  PX2-P2X2  >  0 

a2  -  1+2PX+PX2  >  0 

A  , .  ,2 
a,  3  c  -k  X  . 

3  o  o 


Rewriting  (2.24), 


aa^  +  $ 

*  ■  - -  +  a, a  , 

*  aa0  +  $  3 

A  4 


and  solving 


3R 


3a 


•  0  yield 

±  ^  <0t2-q1)1/2  _ 

(a3)1/2a2  a2 


provided  a2_ul  ^  an<*  a3  ^  w^ere  t^le  former  is  always  satisfied. 


Requiring  a  to  be  real  and  positive  leads  to  constraint  B 1 : 


If  constraint  B1  is  met,  >  0  is  satisfied  and  thus  the  optimum 
encoding  coefficient  is  given  by 


*  ,  *.1/2 

!  "  (a  5  '  ,  Vl/2 

—  a3  °2 


(1+2PX+PX  ) 


2x1/2 


/?(1+PX) 


(c  -k  X  ) 
o  o 


2x1/2 


(2.26) 


Equation  (2.26)  gives  the  minimizing  encoding  coefficient  since  it  is 

2  I  2 

easily  shown  that  3  R|  */3a  >  0  when  Bl  is  satisfied. 

A  * 

We  now  proceed  in  the  other  direction.  Fixing  6(y)  =*  e  u,  <$(z)  ■  A 
and  using  2.18,  the  risk  is  given  by 


*  *  2  *2 
R  *  (A  e  -1)  +  A  $  + 


P[2A  (A  e-1)  E{u8(x)}  +  A  ^E{3(x)}]  +  c  e  ^  -  k  E(8(x)^}. 

o  o 


The  problem  faced  by  the  jammer  becomes 


is1 
if 
M 


m 


RK' 

■Kv 


sup  [(A  2-  k  /P)  E{3(x)2}  +  24  (4  e  -l)E{u6(x)}] 

8  0 


If  e  *0,  the  supremum  is  achieved  by 


8(x)  -  A  -(A%* -i)_  X 

e  (A  -k  /P) 
o 


provided  the  constraint  B2  below  is  satisfied 


B2:  A  -  k  /P  <  0 
o 


Hence,  in  1*2 ,  we  have  a  saddle  point  if: 


*  *  * 

-  A  (A  e  -1) 

*  *o 

e  (A  -k  /P) 
o 


*  * 

where  A  and  e  are  given  by  (2.23)  and  (2.26) 


(2.27) 


(2.28) 


(2.29) 


ii)  constraints  B1  and  B2  are  satisfied. 


Equation  (2.29)  is  a  4th  order  polynomial  in  X.  It  can  be  rewritten  as 


x4[k  (1-P)2  +  *k2]  + 

o  o 


X  [2k  <fr(k  /P  +•  c  )]  + 
o  o  o 
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X^[-c  (l-P)^  +  2$c  k  (1+1/P)  +  $c  ^  +  $k  “VP]  + 
o  o  o  o  o 

X [2$c  (c  +k  /?)]  +  *  c  2  -  0  (2.30) 

o  o  o  o 

A  closed-form  solution  of  (2.30)  has  not  been  found.  However,  as 

given  in  Tables  1-5,  (2.30)  has  been  investigated  numerically  for  a  rich 

class  of  parameters  and  has  been  found  to  possess  real  solutions 

satisfying  constraints  51  and  B2,  in  most  instances.  Appendix  A  lists  a 

FORTRAN  program  which  was  used  to  solve  for  the  real  roots  of  (2.30). 

*  * 

From  the  tables  note  that  e  and  A  are  decreasing  in  P, 

whereas  |  X  |  is  increasing  in  P.  We  see  that  the  actual  power  expended 

2  2 

by  the  jammer,  E{8(x)  }  *  E{[Xeu]  },  increases  as  P  increases,  since  as 

P  increases,  the  jammer  is  more  likely  to  be  on  the  channel.  In  the 

extreme  case  where  P-1,  the  problem  reduces  to  that  treated  in  [3],  and 

(2.30)  can  be  shown  to  be  satisfied  by  X  *  -  c  /k  .  Further,  from  Table 

o  o 

5,  as  the  variance  of  the  channel  noise  $  becomes  dominant,  a  constraint 
(Bl)  becomes  violated,  as  expected,  because  this  noise  now  dominates  the 
channel. 

We  have  thus  shown  that  for  region  R2  of  problem  PI. 2,  the  optimum 
jamming  policy  in  most  instances  Is  a  linear  policy. 
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Numerical  Solution  for  Problem  1.2  in  Region  R£ 


Table  1.  Soft  Constraint  Parameters: 
Channel  Noise  Variance: 


1.0,  k 


p 

* 

e 

* 

A 

* 

X 

R* 

0.1 

0.454 

0.642 

-0.049 

0.9157 

0.2 

0.452 

0.636 

-0.095 

0.9202 

0.3 

0.447 

0.626 

-0.140 

0.9275 

0.4 

0.438 

0.609 

-0.184 

0.9375 

0.5 

0.424 

0.583 

-0.230 

0.9501 

0.6 

0.398 

0.541 

-0.280 

0.9651 

0.7 

0.349 

0.464 

-0.337 

0.9819 

0.8 

0.215 

0.277 

-0.407 

0.9972 

0.9 

Bl  <  0 

,  constraint  violation 

1.0 

c  <  k 
o  o 

2 

/P  ,  not  region  R£ 

Table  2.  Soft  Constraint  Parameters:  c  *  1.0,  k  ■  1.0 

Channel  Noise  Variance:  0.5  ° 


P 

* 

e 

* 

A 

* 

X 

R* 

0.1 

0.454 

0.642 

-0.046 

0.9156 

0.2 

0.452 

0.636 

-0.087 

0.9197 

0.3 

0.448 

0.628 

-0.129 

0.9264 

0.4 

0.440 

0.613 

-0.171 

0.9357 

0.5 

0.428 

0.589 

-0.214 

0.9475 

0.6 

0.406 

0.552 

-0.261 

0.9617 

0.7 

0.366 

0.488 

-0.315 

0.9780 

0.8 

0.267 

0.346 

-0.381 

0.9942 

0.9 

Bl  < 

o, 

constraint  violation 

1.0 

Bl  < 

o. 

constraint  violation 

tiKiyfrjtr, 


9a 


Wj 


W»."  i?i  T*  \T*  V>  H 
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2.1.3  Partial  Saddle-Point  Solution  under  a  Hard  Constraint 
for  the  Encoder  (PI. 3) 


Again  we  consider  the  system  depicted  in  Fig.  2.  For  this  problem, 
fidelity  criterion  C3  is  used.  A  saddle-point  solution  is  obtained  for 
the  following  region  of  the  parameter  space. 


Rl:  k  >  P(c/c2+<(>)2 
o 


(2.31) 


Theorem  2.3  The  coramuni cat ions  problem  PI.  3  admits  a  saddle-point 

*  *  *  p  p 

solution  (y  ,6  ,8  )  in  region  R^  over  I  x  x  1  j  where 


Y  (u)  -  cu 


5  (z) 


8  (x) 


c(H-PA  )z 

c2(l+2PA*+  PA*2)  + 


-  A(A*)z 


(2.32) 


(2.33) 


(2.34) 


A  *  arg  max  [(A(A)c-1)2+A(A)2($+PX2c2)+2PA(\)Ac(A(A)c-1) 1  (2.35) 

X  -k  A2c 

o 


Proof . 


a)  RHS 


From  (2.34),  fix  8(x)  “Ax.  Using  fidelity  criterion  C3,  the 
problem  faced  by  the  encoder-decoder  Is 


inf  E{  (5 ( z )— u ) ^ 
Y,<5 


*2  2 
k  A  y(u)  J 
o 


(2.36) 


I 


E 

ft 


;• 

w, 

w 


1 


:§ 


v  r*vSiV 


2  2 

subject  to  E{y(u)  }  <  c  . 

Recall  from  Theorem  2.1,  the  problem 

inf  E{(6(z)-u)2}  subject  to  E(y(u)2}  <  c2 
Y  »<S 

was  shown  to  have  a  minimizing  solution  given  by  y(u)  =  cu.  Since 
★2  2 

kQ  X  E(y(u)  }  is  maximized  by  y(u)  =*  cu,  the  infimization  of  (2.36)  is 

* 

also  solved  by  y  (u)  *  cu,  verifying  (2.32).  Straightforwardly,  it  is 
easy  to  show  the  optimum  decoding  policy  is  given  by 


S*(z) 


c(l+Pl  )  z 

2  *  *2 
c  (1+2PX  +PX  )+$ 


A(X*)z 


verifying  (2.33) 


(2.37) 


b)  LHS 

Fix  y(u)  *  cu,  5(z)  *  A(X)z.  The  problem  now  faced  by  the  jammer 
is  exactly  the  same  as  that  treated  in  Section  2.1.2,  i.e., 


sup  [(A(X)2-k  /P)  E{8(x)2}  +  2A(X)(A(X)c-l )E{u8(x)} ] 
a  o 


The  supremum  is  achieved  by 


0*  (x) 


-A ( X* ) ( A( X* )c~l ) 

c(A(X*)2-k  /P) 
o 


(2.38) 
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provided 


MX*)2  -  k  /P  <  0 
o 


(2.39) 


Using  (2.35),  it  is  easy  to  show  that  X  e(-l/P,0).  From  (2.37),  it 


follows  that 


0  <  A (X )  <  c/(c  +<fr)  for  X  e(-l/P,0) 


*  2  2  2  2 
Consequently,  A(X  )  -  kQ/P  <  0  is  satisfied  whenever  kQ/P  >  c  /(c  -t-d* )  . 


which  is  precisely  region  Rp  The  proof  is  now  complete. 


2.1.4  Minimax  Solution  under  a  Hard  Constraint  for  the  Jammer  (PI. 4) 


We  again  consider  the  system  depicted  in  Fig.  2.  For  this  problem, 


fidelity  criterion  C4  is  used.  A  miniraax  solution  is  obtained  for  the 


following  regions  of  the  parameter  space. 


*  2  2 
E^:  (e  )  >  Pk 


1*2  •  e 


(2.40) 


where 


e  ■  arg  min  f(c) 
c>0 


(2.41) 


c  c^  +  [(A(c)c~1)2  +  A(c)^($+Pk^)-2KPcA(c)(A(c)~l/c)  c^>Pk^ 
o 


c  c  +1 
o 


2  2 
c  <Pk 


(2.42) 
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[c  -2kPc  +Pk  +$  ] 

We  first  will  show  that  problem  PI. 4  with  an  enlarged  information 
structure  admits  a  saddle-point  solution.  Then  we  will  show  this 
saddle-point  solution  corresponds  to  the  rainimax  solution  of  our 
original  problem. 

Consider  first  the  problem 


min  E{(5(z)-u)2}  E{y(u)2}  <  c2  E{v2}  <  k2 


which 

is  a  simplified 

version 

of 

problem 

Pl.l 

obtained 

by 

setting 

o  -  <f>,  *  0 

and  <f>2 

a  <f>  in  Fig 

.  1. 

Suppose 

the 

jammer 

has 

2 

knowledge  of  llxll 

«  E{x2} 

and  uses 

the 

strategy 

8(x)  =* 

-kx/  llxll . 

It 

follows 

2 

that  E{ v  } 

-k2. 

Further, 

the 

minimum  value  of 

this  problem 

using  this  policy,  denoted  by  R  (c),  is  a  decreasing  function  of  c,  and 

2.  2 

is  achieved  by  E{y(u)  }  *  c  .  Using  Theorem  2.1,  we  can  rewrite  (2.42) 


2  * 

c  c  +  R  (c) 
o 

c  c2  +  1 
o 


2  2 

c  >  Pk 

2  2 

c  <  Pk 


(2.44) 


where  R*(c)  <  1  for  c^  >  Pk^.  For  our  problem,  we  use  fidelity 

criterion  C4,  and  the  problem  becomes 


>  V-W  ’A'.vV.  'v' 


min  min  E{c  y(u)  +  (<5(z)-u)  } 
c>0  y ,S  ° 


E{y(u)2}  =*  c2 

2  2 
E{v  }  <  k^ 


(2.45) 


or  equivalently 


min  (c  c2  +  R  (c)]  (2.46) 

c>0  ° 


It  follows  that,  if  e  given  by  (2.41)  satisfies 


*  2 
e  >  Pk  , 


which  is  precisely  region  R^,  the  optimum  encoding-decoding  policies  are 

*  * 

given  by  y(u)  *  e  u,  5(z)  *  A(e  )z.  Using  these  policies,  it  is  clear 
that  the  optimum  strategy  for  the  jammer  is  to  use  maximum  power, 
i.e. ,  8  (x)  =■  -kx/Jxil . 

★  2  * 

From  (2.41),  it  follows  that  either  e  >  Pk  or  e  =  0.  We  now 

consider  the  case  e*  =*  0.  For  this  encoding  policy,  it  follows  that  the 

* 

optimum  decoding  policy  is  5  (z)  =0.  Hence,  the  cost  becomes 
independent  of  the  jammer's  policy  making  any  policy  8  e  f”j  a  maximizing 
policy.  If  the  jammer's  policy  is  fixed  as  6(x)  =  -x/P,  the  problem 
faced  by  the  encoder-decoder  reduces  to 


min  E{c  y  (u)  +  1} 

r  0 

Y ,  <S 

*  * 

which  is  clearly  minimized  by  (y  ,{  )  *  (0,0). 

What  we  have  shown  above  is  that  a  saddle-point  solution  exists  to 
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$  l 
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■  1 
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% 
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the  problem  with  enlarged  information  structure  in  two  regions  of  the 
parameter  space.  Equivalently,  a  saddle-point  exists  if  the  jammer  is 
assumed  to  tap  the  source  message  directly. 


Theorem  2.4  The  communication  problem  PI.  4  admits  a  minimax 


*  *  * 

solution  (y  ,<$  ,8  )  over 


rx  dz  x  n  where 


*  * 

5  (u)  =*  e  u 


6  (z) 


Me  ) 


(2.47) 


(2.48) 


m 


8*(x) 


-(k  /e  )x 
o 


-  x/P 


(2.49) 


with  e*  given  by  (2.4|),  and  Me  )  by  (2.43). 


Proof . 


We  need  to  show  that  the  mlniraax  solution  to  problem  PI. 4 
corresponds  to  the  saddle— point  solution  to  the  problem  with  enlarged 
information  structure  discussed  above.  For  5  fixed,  let  8  be  an 


arbitrary 


element 


<  Let  6  e  lj,  where  8  *  8(x,5) 
'"*2  2 

satisfies  E{8(x,5)  }  <  k  .  Then 


of  f?  satisfying  E{3(x)  } 


min  [max  R(y,5,8)]  *  min  [max  R(y,<5,8)' 

Y,5  8  Y,5  8 


(2.50) 


37 


because  for  fixed  Y*|S»  the  inner  maximization  problems  are  the  same. 
The  LHS  of  (2.50)  corresponds  to  the  problem  with  enlarged  information, 


whereas  the  RHS  is  the  problem  PI. 4.  Equations  (2.47)-(2.49)  thus 

* 

follow,  where  Hxll  3  e  is  used  in  (2.49).  The  proof  is  now  complete. 

2.2  Problems  2  and  3 

2.2.1  Saddle-Point  Solution  for  Mixed  Encoder  (P2) 

The  communication  system  under  consideration  is  depicted  in  Fig.  3. 

Theorem  2.5  The  communications  problem  P2  admits  a  unique  saddle-point 

*  *  -k  __  p* 

solution  (y  ,5  ,  8  )  over  x  x  /  j  where 


/  cu,  cz/(c2+Pk^+£) 

*  *  \ 

w.p.  0.5 

(Y  ,6  )  - j 

(2.51) 

(j-cu,  -cz/(c2+Pk2+$) 

w.p.  0.5 

6  (u)  =  n,  E{n}  ■  0,  E{n2}  =  k2, 
independent  of  u,  v,  and  w 

(2.52) 

and  the  saddle-point  value  of  R  is 


★  *  it  it 

R  (Y  ,5  ,8  ) 


(Pk2  +  <J>)/(c2+Pk2+d>) 


(2.53) 


I 

Proof. 
as  y(u) 


5 


Since  yt  |  e  ,  the  encoder 
cu  for  some  random  variable  c, 


policy 

assumed 


can  be  expressed 
to  be  independent  of 


u,  w,  and  v.  Thus  E{$  }  <  1  is  necessary  to  satisfy  the  channel  input 
power  constraint.  Using  criterion  Cl,  the  risk  becomes 


R  *  E{4  cc-l)2>  +  A2$  +  2PA  E{A  tc-l)uB(u)}  +  PA2E{B(u)2}  (2.54) 

£  £  Q  s  £ 


where  the  decoding  coefficient  A^  is  a  deterministic  scalar  dependent  on 
the  distribution  of  the  random  variable  5.  We  now  verify  that  the 
solution  given  by  Theorem  2.5  satisfies  the  LHS  and  RHS  inequalities  of 
a  saddle  point. 


a)  RHS 


Fix  B(y)  “  n  as  given  by  (2.52).  Then  (2.54)  becomes 


R  -  A2*  +  E  {A  cc-l)2}  +  PaV 

4  s  s  s 


2  2  2  2 
Conditioning  on  (2.55)  reduces  to  A^_$  +  (A^^c-l)  +  PA^k  . 


Setting  3R/3A^  «  0  yields 


?  U2c2+Pk2+4>  ] 


(2.55) 


(2.56) 


Equation  (2.56)  gives  the  unique  optimum  linear  decoding  coefficient, 
2  2 

since  3  R/3A^  >  0.  Substituting  (2.56)  into  (2.55),  we  lower  bound  R  by 


Since  6(z)  =  A  z  is  an  admissible  decoding  policy  (because  of  Che 
presence  of  the  side  channel)  equality  holds  in  the  above  and  the 
problem  becomes 


inf  „  (  (Pk  +  <j>)  I  , 

X(?)  C  \  (?2c2  +  p^2  +  ^  j  subject  to  E{?  }  <  1 


(2.57) 


where  \  e  JL  m  set  of  all  probability  measures  on  f1  x  .  Recall 
that  D  *  the  space  of  all  linear  deterministic  mappings  from  |R  to  R  . 

x  x 

Any  X  elL  thus  induces  a  pair  (y  ,6  )  e  I  e  x  D^. 

The  infimization  of  (2.57)  depends  only  on  the  second  moment 

2 

of  C,  and  thus  can  be  achieved  by  any  X  such  that  E{5  }  *  1.  Clearly, 


X*(C) 


w.p.  0.5 
w.p.  0.5 


(2.58) 


is  an  optimal  measure.  Using  (2.56)  and  (2.58)  we  obtain  (2.51)  as  the 
optimal  encoding-decoding  strategy, 
b)  LHS 

2  2  A  * 

1.  First,  fix  (y,S)  *  (cu,cz/(c  +Pk  +$))  =*  (cu,A  z)  .  Then,  the  risk 
associated  with  this  pair  is  given  by 


(’ll  *  2 

RU;  *  E{  (A  z-u)  } 

=  (A  c— 1)^  +  (A  )^$  +  P(A  )^E{S(u)^}  +  2PA  (A  c-1)  E{u8(u)} 

* 

2.  Now  fix  (y,<5)  *  (-cu,-A  z) 

Then, 


(2)  *  2 
V  ’  =■  E{ ( -A  z-u)  } 


I 


j! 

( 

i 


% 

$ 


& 

$ 


V, 

* 

m 

I 


a 

§ 

SI 

w1 


j 


(A  c-1)  +  (A  )  *  +  P(A  )  E{8(u  )}  -  2PA  (A  c-1)  E{u8(u)} 


Clearly  then,  the  value  under  the  mixed  policy  given  by  (2.51)  is 


R  -  0.5  Rx  +  0.5  R2 


(A*c-1)2  +  (A*)%  +  P( A*)  2  E{g(u)2} . 


This  is  independent  of  the  correlation  E{uS(u)},  and  is  maximized  by  the 


2  2 

choice  of  a  random  variable  n  M  8(u)  such  that  E{3(u)  }  *  k  ,  verifying 


(2.52).  Further,  from  (2.57),  the  saddle-point  value  of  R  is  given  by 


(2.53).  This  completes  the  proof  of  Theorem  2.5. 


Corollary.  The  encoder-decoder  policy  given  by  (2.51)  is  the  unique 
optimal  solution  over  Te'  x  D^,  where  the  space  (  e ’  is  induced  by 

•  »  1-1 

\  e  Il_  ,  where  1L_  *  the  set  of  all  probability  measures  on  /  x  such 

that  |cc|  <  c  w.p.  1.  Further,  in  this  case,  8  e  fj  has  the  property 


that  E{u8(u)}  *  0. 


Proof .  Under  the  restriction  that  c  <  1  w.p.  1,  the  entire  class  of 


optimum  policies  for  the  encoder-decoder  is  given  by 


(y>,$) 


cu,  cz/ (c2+Pk2+$ ) 


w.p.  r 


-cu,  -cz/(c2+Pk2+$) 


(2.59) 


w.p.  1-r 


Using  this  mixed  policy, 


* 


R  -  (A*c-1)2  +  (A*)24>  +  P( A*) 2  E(8(u)2}  +  (  2r-l )  PA*( A*c-1  )E  Wu ) } 


Since 


A  c-1  <  0,  the  jammer  could  use  6(u)  *  -sgn(2r-l)ku,  so 


*  2  2  ~  * 

that  E{8(u)  }  *  k  ,  but  results  in  R  >  R  .  Clearly  (2.59)  is  optimal 
only  if  r  1  0.5. 

Now,  suppose  E{u8(u)}  *  0.  Then  the  encoder-decoder  pair  can  be 
chosen  as  in  (2.59)  with  r=*0  if  E{u8(u)}  >  0,and  r  *  1  if  E{uB(u)}  <  0, 
leading  to  R  <  R*.  Thus,  a  8  e  ("j  with  E{u8(u)}  *  0  cannot  be  optimal 
for  the  jammer. 


2.2.2  Minimax  Solution  for  Deterministic  Encoder  (P3) 


Consider  first  the  structure  depicted  in  Fig.  2,  where  the  jammer 


3 


has  access  to  the  encoded  message.  The  structure  of  Fig.  2  can  be 
obtained,  by  setting  *  a  =•  0  and  *  $  in  Fig.  i.  Clearly  then, 


inf  sup  R(y,5,8(x))  <  inf  sup(Y,6,6(u))  (2.60) 

(y,5)e  lx  D  Be  fj  (y,5)e  lx  D  Be  fj 


since  x  *  y(u).  Recalling  Pl.l  admits  a  saddle-point  solution,  denote 
the  LHS  of  (2.60)  by  R  ,  where  the  tilde  signifies  the  simplified 
version  of  Pl.l.  The  RHS  of  (2.60)  is  the  minimax  problem  of  P3. 
Equation  (2.60)  says  that  the  minimax  value  for  P3  is  bounded  from  below 


by  R  ,  i.e. , 


— * 

R  <  R 


(2.61) 


Theorem  2.6  The  communications  problem  P3  admits  two  minimax 

It  ——'ft  it  — A  lie  it  ^  ^ 

solution  xY  ,6  ,8  )  and  (~y  , -2  )  over  I  x  D  x  !  j 


whs  re 


( 


Y  (u)  *  \ 


arbitrary 


in  R 


1 


cu 


6  (z) 


0 

c-kP 


in  R, 


[c2-2kPc+Pk2+<j>] 


A  * 
2  “ 


(l/c)z 


r2  n  r3 
*2fK 


8(u) 


8(u) 

-ku 

8(u) 


6  e  [""j  arbitrary 


s.t.  E{8(u)  }  *  k' 


in  R, 

r][)r 


2  U  4 

r3 


and 


(2.62) 


(2.63) 


(2.64) 


(  1 


R  (y  ,6  ,8  ) 


in  R 


*  2  *2  2 
(A_  c-1)  +  a/(4>+pO 

3  R3 

(Pk  +$) 


1 


2kPcV<V-1/c)  R2^R3 

R2  f)  R4 


3  3 


(2.65) 


The  regions  of  the  parameter  space  are  given  by 


Rji  k/c  >  1/P 


R- :  k/c  <  1/P 


R_:  Pk  —  kPc  +  $  >  0 
J  2 

R^ :  Pk  -  kPc  +  <j>  <  0 


(2.66) 


Proof .  This  proof  follows  closely  the  proof  of  Theorem  3  in  [1]. 
First,  note  that  the  above  regions  correspond  precisely  to  the  regions 
given  in  Theorem  2.1  with  the  simplifications  o  =  =  0,  and.  <j>2  *  $• 

The  parameter  X  of  Theorem  (2.1)  simplifies  to  X  *  -k/c.  Next,  the 

— if 

minimax  value  R  for  problem  3  satisfies 


R  <  sup  R(y,S,B(u))  for  all  y  t  ,  5  e  D  . 
Be  fj 


We  will  verify  that  with  (y,<S)  fixed  as  in  (2.62)  and  (2.63),  the 
following  equation  holds. 


sup  R(y  ,  5  ,  B(u))  *  R(y  ,  S  ,  B  (u))  =  R 
Be  Tj 


(2.67) 


Along  with  (2.61),  this  shows  that  R  =  R  .  That  is,  the  rainimax 

value  of  problem  P3  is  Identical  to  the  saddle-point  value  of  the 

— *  — *  — * 

simplified  version  of  Pl.l.  Hence,  (y  ,  5  ,  B  )  constitutes  a  minimax 
solution  for  P3. 

The  proof  proceeds  by  verifying  (2.67)  in  the  different  regions. 


Rj.  Since  5  (z)  *  0,  from  (2,63),  using  criterion  Cl  we  obtain 


R(y ,<5  ,3)  -  E{ (u-0)  }  -  1 


for  all  8e(j«  Clearly  Chen  (2.67)  holds  in  Rp 

R2 (l  R3.  Wich  (y  ,5  )  given  by  (2.62)  and  (2.63),  we  obtain 


R(7*,6*,8)  “  (A*  c-1)2  +  (aJ  )%  +  2PA^  C_1)  E{u8(u)}  (2*68) 

8  2  *  2  2  22 
+  P(Ar)Z  E{S(u)Z}. 


The  above  is  maximized  uniquely  by  8  (u)  =  -ku,  since  Che  coefficient 
A*  (A*c-1)  is  negative  in  R~  0  Rv  Substituting  into  (2.68)  yields 

R(V*,^*.^*)  ■  (Ar  c-1)2  +  (Ar  )2(<j>+Pk2)  -  2PkAR  (A^c-1) 

Using  Theorem  2.1  with  4>  L  -  a  »  0,  it  is  easy  to  show  that 

R(y  ,5  ,8  )  =  R  . 

Thus,  (2.67)  is  verified  in  R2  H  83- 

R2  0  R4  Wich  (Y*,S  )  given  by  (2.62)  and  (2.63),  we  obtain 

R(Y  ,6  ,8)  ■  E{(u - *(cu+v+w) )2} 

m  ~2+h  E{(8(u))2} 

c  c 


This  is  maximized  by  any  random  variable  8(u)  with  second  moment  equal 


yj 


to  k  •  Thus  R(y  ,5  ,8  )  =  (Pie  +<fr)/c  •  Again  using  Theorem  2*1,  we  see 
R(y  ,o  ,8  )  =  R  oO  that  (2.67)  is  verified  in  0  R4  • 

— *  — *  * 

From  all  of  the  above,  it  is  clear  that  (-y  ,-6  )  also 

constitutes  another  minimax  solution  for  problem  3.  The  proof  is  now 
complete. 


2.2.3  Maximin  Solution  for  Deterministic  Encoder  (P3) 


Theorem  2.7  The  communications  problem  P3  admits  2  maximin  solutions 

*  *  *  *  *  ★  p-^  n 

(y_  ,  5_  ,£  )  and  (~y_  ,~§_  ,£  )  over  I  x  D  x  |  j  where 


y  (u)  *  cu 


6  (z)  *  cz/(c^+Pk 2+4>) 


(2.69) 


(2.70) 


S  (u)  ■  n  E{n2}  »  k2,  E{un)  *  0 


(2.71) 


R*(V\  £*,£*)  -  (Pk2+<j>)/ (c2+Pk2+$) 


(2.72) 


Proof .  This  proof  follows  closely  to  that  of  Theorem  5  in  [1]. 
Let  y(u)  *  eu  and  5(z)  *  Az. 

Thus,  using  criterion  Cl,  we  obtain 


R(y,<5,8)  *  E { ( u~A ( eu+v+w )  )) 


(Ae~l)^  +  A%  +  2PA(Ae~l)t  +  A2p2 


(2.73) 


iViVr 


,iW 


where  p  *  PE{8(u)  } 
t  -  PE{u8(u )} 


(2.74) 


Setting  3R/3A  *  0  yields 

a*  ,  (e+t) 

A  2  2 

(e  +p  +$+2et) 

as  the  unique  minimizing  A  for  any  encoder  x  =  eu  since 
3^R/3A^  *  2e^  +  2$  +  2p^  +  4et  >  0 


(2.75) 


Substituting  (2.75)  into  (2.73)  yields 


2  2 

o  I  ,  P  H-t 

Kl  *  2  2 

A  e  +p  +$+2et 


(2.76) 


2 

Now,  optimizing  with  respect  to  the  encoding  coefficient,  we  see  that  e 
should  be  chosen  as  large  as  possible.  The  terra  et  should  also  be 
chosen  to  be  as  large  as  possible.  This  leads  to  the  optimum  encoding 
coefficient  e*  where 


* 


e 


t  >  0 
t  <  0 

t  =  0 


(2.77) 


Substituting  (2,77)  into  (2.76),  we  obtain 


MMj 


*  * 
A  ,e 


c  +  p  +$-2ct 

2  2 
P  +»-t 

2  2 

c  +p  +$+2ct 


(2.78) 


t  >  0 


We  observe  that  (2.78)  is  an  Increasing  function  of  p  ,  and  thus  is 
2  2  2  2  2 

maximized  over  p  subject  to  p  <  Pk  by  p  =  Pk  .  Now  maximizing  over 

2  2 

t,  after  substituting  p  ■  Pk  ,  we  obtain 


*  * 
A  ,e 


-(Pk  -hfr~ct)(t~c) 
(c^+Pk^+$+2ct ) 
-(Pk^+<fr+ct )( t+c) 
(c^+Pk^+$+2ct ) 


t  <  0 


t  >  0 


(2.79) 


Equation  (2.79)  is  continuous  in  t,  decreasing  for  t  >  0,  increasing  for 
t  <  0.  Thus,  (2.78)  has  a  unique  maximum  at  t  *  0.  Substituting  t  =  0 
into  (2.75)  and  (2.77)  yields  the  encoding-decoding 

•k  k  k  k 

pairs  (j^  ,6_  )  and  (~y_  ,-5_  )  .verifying  (2.69)  and  (2.70).  Further, 
using  these  encoding-decoding  policies,  it  follows  that  the  optimum 
jamming  policy  is  any  second-order  and  random  variable  n  such 


2  2  2 
that  t  »  PE{un)  ■  0  and  p  =*  PE{n  }  *  Pk  . 


This  verifies  (2.71). 


Substituting  t  =  0  into  (2.78)  verifies  (2.72).  This  completes  the 
proof  of  Theorem  2.7.  Note  that  this  maximin  value  is  the  same  as  the 
saddle-point  value  obtained  in  Theorem  2.5. 


2.3  Summary  and  Discussion  of  Solutions 

In  the  previous  two  sections,  6  different  communications  problems 


kt. 


pmpff  *?rro  ?  tto  *>■’>  ■>'  ■>■  t7 t:7.v;, 


were  examined.  In  some  cases  saddle-pol ”t  solutions  were  derived, 
whereas  in  other  cases,  minimax  or  maximin  solutions  were  obtained.  We 
have  seen  that  the  solutions  often  differed  for  different  regions  of  the 
parameter  space.  In  most  Instances,  the  optimum  jamming  policy  w-s 
found  to  be  a  linear  transformation  of  the  observed  variable,  plus,  in 
some  cases,  an  additional  independent  noise  variable.  The  optimum 
encoding  and  decoding  coefficients  were  shown  to  be  highly  dependent  on 


the  regions  of  the  parameter  space 


CHAPTER  3 


CONCLUSIONS 


3.1  Summary  of  Results 

The  principal  objective  of  this  thesis  has  been  to  obtain  saddle- 
point  or  worst-case  solutions  for  a  class  of  communication  problems 
involving  an  unknown  probabilistic  jammer.  Although  the  basic 
communication  structures  have  been  examined  previously,  this  treatment 
is  the  first  considering  a  probabilistic  jammer.  Specifically,  the 
problems  involved  the  transmission  of  a  Gaussian  random  variable  over  an 
additive  white  Gaussian  channel  subject  to  unknown  probabilistic  jamming 
noise  generated  by  an  intelligent  jammer.  The  jammer  was  intelligent 
because  he  had  access  to  the  encoded  message  (or  a  noisy  version 
thereof)  or  the  actual  source  message.  Equivalently,  the  problems  can 
also  be  viewed  as  the-  transmission  of  a  sequence  of  independent, 

identically  distributed  Gaussian  random  variables  over  a  discrete-time 
additive  white  Gaussian  channel.  A  variety  of  quadratic  distortion 
criteria  were  used  to  measure  performance. 

In  Chapter  1,  we  first  introduced  the  problems  and  provided  some 
brief  motivation.  This  was  followed  by  a  quick  review  of  the  recent 
literature.  Next,  a  complete  description  of  the  6  communications 

problems  was  given.  Chapter  2  presented  the  results  via  the  theorem- 

proof  type  approach.  Either  saddle-point,  minimax,  or  maximin  solutions 

were  obtained  for  each  of  the  problems;  however,  for  2  problems  (PI. 2 
and  PI. 3)  only  partial  solutions  were  found,  meaning  that  solutions  for 
all  regions  of  the  parameter  space  could  not  be  obtained.  In  the  case 


&  & 


..  & 
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of  saddle-point  solutions,  the  main  technique  was  to  show  that  the 
policies  satisfy  the  LHS  and  RHS  inequalities  of  a  saddle-point. 
Various  other  techniques  were  used  in  the  derivation  of  other 
solutions.  For  example,  in  Section  2.1.4  a  problem  with  enlarged 
information  structure  was  first  considered;  then,  it  was  shown  that  the 
solution  to  problem  PI. 4  was  equivalent  to  the  solution  obtained  with 
the  enlarged  information  structure. 


3.2  Continuation  and  Extensions 

As  mentioned  in  Chapter  1,  we  have  restricted  ourselves  to 
obtaining  optimal  linear  encoding-decoding  policies  due  to  problem 
tractability .  In  previous  work,  where  with  P  =■  1  the  jammer  is  always 
present,  the  optimal  decoding  policy  when  criteria  Cl  is  used  is  the 
conditional  mean  estimate.  It  turns  out  that  this  conditional  mean 
estimate  is  linear  in  the  observation  variable.  However,  for  the  case 
of  the  probabilistic  jammer  treated  here,  the  conditional  mean  estimate 
is  highly  nonlinear  involving  Integral  expressions.  This  motivated  the 
restriction  to  obtaining  optimal  linear  policies.  A  possible  extension 
would  be  to  consider  general  probability  distributions  on  the  jammer's 
output  as  opposed  to  a  two-point  measure  (present  w.p.  P,  not  present 
w.p.  1-P)  which  might  result  in  a  more  implementable  form  for  the 
conditional  mean  estimator. 

This  restriction  to  obtaining  optimal  linear  policies  was  also  made 
in  [2]  where  an  extended  model  with  a  vector  communication  channel  is 
considered.  As  mentioned  in  [2],  even  when  no  jammer  is  present,  the 
optimal  solution  is  nonlinear.  It  seems  feasible,  however,  that  optimal 
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linear  policies  for  the  case  of  probabilistic  jammer  could  be  obtained 
for  that  vector  case  also. 

An  interesting  extension  to  the  problems  considered  here  would  be 
to  investigate  the  structure  depicted  in  Fig.  4.  This  structure  is 
similar  to  that  in  [7],  The  source  is  considered  to  be  a  discrete-time 
Markov  process  {mc)  described  by 


Vi  =  Vt  +  Vt  c-°» 1 » •  *  • 


The  sequence  {5t}  is  an  appropriately  dimensioned  white  noise  process, 
At  and  Bt  are  matrices,  and  mQ  is  Gaussian  with  zero  mean  and  variance 
qQ.  The  times  denoted  by  {t^  :  j=*l,...,n}  are  subtime  indices  between  t 
and  t+1,  and  refer  to  the  fact  that  the  channel  can  be  used  n  times 
between  successive  input  variables  rat  and  mt+p  Also  notice  in  Fig.  4 
the  presence  of  a  noiseless  feedback  link  between  the  input  of  the 
decoder  and  encoder.  This  enables  the  encoder  to  monitor  the  input  to 
the  decoder,  hence  leads  to  the  encoder  possibly  solving  a  detection 
problem  (in  the  case  of  a  probabilistic  jammer)  to  decide  if  on  its 
previous  transmission  the  jammer  were  present. 

In  [7],  the  jamming  noise  {v  }  was  considered  to  be  correlated 
with  the  encoded  signal  {x  },  or  taken  to  be  independent  of  {x^ ^ }  and 
all  other  random  processes.  It  was  shown  that  saddle-point  solutions 
exist  for  both  problems.  Possible  further  work  could  be  done  in 
examining  the  structure  of  Fig.  4  and  obtaining  minimax  and  maxirain 
solutions  under  various  performance  criteria. 
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APPENDIX  A 


FORTRAN  LISTING  OF  PROGRAM  USED  IN 


NUMERICAL  SOLUTION  OF  PROBLEM  PI. 2 


P  ROGRAM  ROOTS  <  ROUT  ,  OUTPU  T'  -ROU  T  ) 

REAL  A  <  S  >  #Bl,B2,KO,CO,PHE<L,E,D,R 
COMPLEX  Z<4> 

INTEGER  IER 
CO=l  . 

KO“  t  . 

PHE  » 1  .  S. 

NOE.C-4 

PRINT*  .  1  PARAMETERS  FOR  T  HIS  RUN  :  CO  ,l<0,  PHE  ,  CO/KO  ' 

PRINT#  ,CO,KO,  PHII  ,  CO/KO 
DO  1.0  P«.l,  t.Ot,  .1 

A<li*KO#(x»P'«##2  +  RHL»KO#k.! 

A<  £  >  »2  »KO*PHi::.*  <  KO/P+CO  > 

A  <  3  ;  «-CO#  <.  1— P  >  ##2+2#PHE*i:0#«<  0«  v  1  l/F  )  +  PHC.#CO#  *  O-*  <  i;,HE/P  )  *KO##2 

A<  A ) -2*PHE*CO# <  CO^KO/P) 

A  <  S  > •PHE#CO#*2 
CALL  ZPOLft <  A , NDI~G ,2,1 ER ) 

PRINT* . P 

PRINT# . ‘THE  A  ROOTS  ARE  * 

PRINT# , Z 

PRINT#.  CONSTRAINTS  1 
lp‘  'CO  .LT.  KO/P#*2)  THEN 

PRINT*.  'CO  L  E  S  S  THAN  ••  O  ✓  *  *  >  S A  T  I  S  F:  1  ED  ‘ 

PR  I  NT *  .  ' 

DO  120  l  -1  ,  A 
L 31  REAL  '  Z  (  I  )  ) 

CF  iCO-KO#L»#2  - GE .  O*  THEN 

bl=  <  PHE#*  .  3  )  »  <  i-^P*L  )  /  <  CO-KO*L«  *2  )  *#  .  5  —  PHE 
IF  ( 81  .  GE.  0>  THEN 

PRINT#, 'Bi  >-  O,  CONSTRAINT  O.K.' 

E«*i  /  <  1*2*P#L  *P*L**2  )  ##  .  5  *  61  *#.5 

D~E*  <  1  ♦■P*L  >  /  <  E *  *2#  <  1  ♦■:»»P*L  *P*|.  *»£  >  *PHE  > 

£<2~D**£— KO/P 

IF  CB?  .  Lf,  O)  THEN 

PRINT*  .  ’  M' <  O,  CONSTRAINT  O.K.  ' 

PRINT*.  *  ENCODING ,  DECODING.  LAMDA .  R*' 

R«E*#2*P*L##2#  <■  1.  -P  '  •■PHE/'  <  E**£*  (  i  ♦*'.>*»■  *L*P*L  **2  >  “PHE  )  ■> 

<  CO-l«)#L##2  )  *c.  *  *:. 

PRINT* . E . D , L , R 

ELSE 

PR  T  NT  *  .  '  D-'  CC  INC  T  RP  f  N  T  V  .1  OLA  ’  I  ON  * 

END  nr 


PR  I  NT  *  ,  1  &  1  <  O  .  CONS' TR  A  INT  Vi  OLA  T  J  ON  ' 

END  I F 
PRINT*. ' 

ELSE 

PRINT*, 'CO-KO#L#*2  NEGATIVE,  CONSTRAI 
PRINT* . ' 

END  IF 
CONTINUE 

EL  SI". 

PRINT*  'CO  NOT*  <  h')/y**2  NOT'  iVfeX  LON  R2  ' 

END  IF 
PR INT*, 

CON  i  tN‘JE 
STOP 

i;:nd 


CONSTRAINT  VIOLATION' 


r,*?W 
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